Society 


712CD 


73rd  MORSS  CD  Cover  Page 

UNCLASSIFIED  DISCLOSURE  FORM  CD  Presentation 


For  office  use  only  41205 


21-23  June  2005,  at  US  Military  Academy,  West  Point,  NY 

Please  complete  this  form  712CD  as  your  cover  page  to  your  electronic 
briefing  submission  to  the  MORSS  CD.  Do  not  fax  to  the  MORS  office. 


Author  Request  (To  be  completed  by  applicant)  -  The  following  author(s)  request  authority  to  disclose  the 
following  presentation  in  the  MORSS  Final  Report,  for  inclusion  on  the  MORSS  CD  and/or  posting  on  the 
MORS  web  site. 


Name  of  Principal  Author  and  all  other  author(s):  David  A.  Flanigan 


Principal  Author’s  Organization  and  address: 

Johns  Hopkins  University  /  Applied  Physics  Laboratory 
11100  Johns  Hopkins  Road 
Laurel,  MD  20723 


Email:  david.flaniqan@ihuapl.edu 


Phone:  240-228-8129 
Fax:  240-228-5229 


Original  title  on  712  A/B:  System  of  Systems  Operational  Analysis  within  a  Common  Operational  Context 


Revised  title: 


Presented  in  (input  and  Bold  one):  (WG  1_3,  CG _ ,  Special  Session _ ,  Poster,  Demo,  or  Tutorial): 

This  presentation  is  believed  to  be: 

UNCLASSIFIED  AND  APPROVED  FOR  PUBLIC  RELEASE 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

01  SEP  2005 

2.  REPORT  TYPE 

N/A 

3.  DATES  COVERED 

4.  TITLE  AND  SUBTITLE 

LCS  Study:  Design  Principles  of  Distributed,  Networked  Forces 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Johns  Hopkins  University/Applied  Physics  Laboratory  11100  Johns 
Hopkins  Road  Laurel,  MD  20723 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release,  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

See  also  ADM201946,  Military  Operations  Research  Society  Symposium  (73rd)  Held  in  West  Point,  NY  on 
21-23  June  2005  . ,  The  original  document  contains  color  images. 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

uu 

18.  NUMBER 
OF  PAGES 

32 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


SYSTEM  OF  SYSTEMS 
OPERATIONAL  ANALYSIS 
WITHIN  A  COMMON 
OPERATIONAL  CONTEXT 


MORS  2005  Conference 
David  A.  Flanigan 


JHU/APL 
22  June  2005 


UNCLASSIFIED 


Ob  j  ectiv  e 


•To  develop  a  process  to  analyze  the  value  of 
a  system  of  systems  (SoS)  effort  towards 
mission  accomplishment 

-  This  example  will  focus  on  a  surface  warfare 
(SUW)  scenario  in  the  littorals  for  describing 
the  process  and  example  analysis 

•  Provide  a  methodology  to  utilize  multiple 
tools  towards  generating  a  solution  to  the 
given  problem  set 
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Agenda 


•  Problem  Space 

•  SoS  Analysis  Process 

-  Scenario  setup 

-  Tie-in  with  other  tools 

-  Execution  &  analysis 

•  SUW  Example 

•  Conclusion 
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Problem  Space 


Within  an  SUW  scenario,  red  platforms  will  attempt  to 
arrive  unhindered  to  their  objective  (typically  a  blue  high 
value  location) 

The  blue  objective  is  to  successfully  intercept  these  red 
platforms  either  prior  to  start  or  during  the  red  transit 

-  This  problem  looks  at  the  transit  phase,  not  at  pre-emptive  strike 
efforts 

-  Blue  surveillance  platforms  and  interceptors  will  be  stationed 
along  the  expected  threat  axis  to  detect  and  track  the  target,  while 
directing  blue  interceptors  towards  the  target 

-  Blue  stationing  may  depend  on  defended  area  requirements,  red 
stand-off  ranges,  available  locations,  etc. 
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Legacy  Solution  Space 


•  The  legacy  solution  space  will  require  multiple 
blue  surveillance  platforms  to  perform  detection 
and  tracking  of  the  target,  directing  blue 
interceptors  towards  the  target 

•  The  legacy  architecture  allows  independent 
detection  and  tracking  efforts,  with  no  fuzed 
tactical  picture  capability 


The  overall  picture  is  only  as  good  as  the 
best  ONE  surveillance  platform  capability! 
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Future  Solution  Space 


•  Explore  the  utility  of  a  system  of  systems 
approach 

•  Each  blue  surveillance  platform  contributes  its 
detection/tracking  of  the  red  threat,  combining 
these  tracks  into  one  shared  picture 

•  The  hypothesis  is  that  a  few  networked  sensors  are 
better  than  many  independent  sensors 

•  This  presentation  will  develop  a  methodology  for 
quantifying  the  added  value  of  the  future  solution 
space 
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SoS  Development  Process 


Construct  a  framework  of  multiple  applications  to 
contribute  towards  a  SoS  representation 

-  SoS  architecture 

-  Scenario  setup 

•  Platform  /  sensor  representations 

-  Scenario  execution 

-  Assessment  functions  (highlighted  in  the  example) 

•  Surveillance  coverage 

•  Interceptor  feasibility 

•  Significant  factors  in  the  scenario 

•  Hypothesis  investigation 
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SoS  Architecture 
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Scenario  Setup 


•  Start  of  the  problem 

•  Define  red  path 

•  Define  blue  surveillance  and  interceptor 
attributes 

•  Define  the  desired  response 

-  Ex:  tradeoffs  between  speed  and  sensor 
performance,  first-order  assessment  of  asset 
placement,  etc. 
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Red  Platform  Attributes 


Develop  a  path  for  the  red 
platform  to  transit  during 
the  scenario 


Construct  a  path  that 
allows  an  opportunity  to 
exercise  the  SoS 

-  A  variety  of  tools  may  be 
used 

-  E  AD  SIM,  LatLonPlot, 
maps,  etc. 

-  Starting  and  ending  points 

-  Speed  of  platform 


EADSIM 
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LatLonPlot 


Blue  Surveillance  Attributes 

•  Develop  a  matrix  of  what  the  blue 
surveillance  platform  is  capable  of: 

-  Number  of  surveillance  assets 

-  Location  during  the  scenario 

-  Capabilities  of  sensor 

•  Range 

•  Scan  rate 

•  Probability  of  detection 
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Sensor  Information  from 

AREPS 


The  use  of  the  Advanced  Refractive  Effects 
Prediction  System  (AREPS)  produced  by 
SPAWAR  provides  the  effects  of  specific  radar 
parameters  to  build  the  characteristic  AEW  or 
interceptor  radar 

Provides  Probability  of  Detection  vs.  Range  plots 
Import  into  MATLAB  to  curve-fit  for  later  use 
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Sensor  Information  from 

AREPS 


AREPS  -  Advanced  Refractive  Effects  Prediction  System  -  [AREPS  Project:  Airborne_Radar] 

&  File  Edit  View  System  Environment  Run  Options  Windows  Help 

_  3  X 

oil#  l  i'  ^lffll*l*|E3|  *06  ¥?l? U 

Sample  AEW  Aircraft 


Areps  3.3 
Radar:  AEW  RADAR 
Ant  ht:  18500  ft 
Platform:  Aircraft 
Target:  MEDIUM  JET 
Env:  <Standard> 

Lat:  33  H 
Lon:  119  W 
Bearing:  90°T 

Current  Position: 
Lat:  32  56  02.62  H 
Lon:  114  56  00.27  W 
Bearing:  90°T 
Range:  204.73  nmi 
Height:  21526  ft 
Loss:  135.1  dB 
Factor:  1.0  dB 
Pd:  17.11  % 


Example  AREPS  Pd  vs.  Range 
raytrace  output 
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Sensor  Information  from 

AREPS 


Pj  AREPS  -  Advanced  Refractive  Effects  Prediction  System  -  [Radar  Editor  [AEW  RADAR]] 


E'le  Edit  View  System  Environment  Run  Options  Windows  Help 


BBS 
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Classification  Radar  Calculations/Type 


<•  NONE 
Level  1 
Level  2 
C  Level  3 


(*  Simple  pulsed  radar 
C  Integrated  -  Incoherent 
C  integrated  -  Coherent 
C  CW  or  other  radar 


Optional  information 
Oil 
0=E 


Vertical  Antenna  Pattern 


Latitude  (Deg) 
Longitude  (Deg) 


|10.  Antenna  height  (ft)  (MSL) 
(unknown 

None  ▼  Associated  weapon 


’ll 


Your  identification  label 
Frequency  (MHz) 


SinXW 


▼  j  Antenna  type 


1000.  Peak  power  (kW) 

Pulse  length  (|is) 

Compressed  pulse  length  (ps) 

Receiver  noise  figure  (dB) 

Assumed  system  loss  (dB) 

Maximum  instrumented  range  (km) 
200.  Pulse  rate  (Hz) 

0.  Free-space  range  (1  sqm  target)  (km) 

1.0E-08  ▼  Probability  of  false  alarm 


25. 


200. 


Horizontal  Polarization 

Hits  per  scan 

Antenna  gain  (dbi) 

Antenna  scan  rate  (rpm) 
Horizontal  beam  width  (Deg) 
Vertical  beam  width  (Deg) 
Antenna  elevation  angle  (Deg) 


12. 


10. 


Pattern  angle 
(Deg) 


Pattern  factor 
(dbi) 
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data  from  AREPS 


□ 

Figure  1 

B0® 

File  Edit  View 

Insert  Tools  Desktop  Window  Help 

□  g?  h  m 

k  i«t9.  n  ®  «  □  m 

a  0 

range  vs  Pd 


Import  data  into  MATLAB  after  curve-fitting 
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Blue  Interceptor  Attributes 


•  Develop  a  matrix  of  what  the  blue  interceptor  is 
capable  of: 

-  Number  of  interceptor  assets 

-  Location  during  the  scenario 

-  Capabilities  of  interceptor  sensor 

•  Maximum  effective  range 

•  Scan  rate 

•  Probability  of  detection 

•  Effective  (fuze)  range 

-  Range  of  initiation  of  interceptor 
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Scenario  Execution  Example 


•  MATLAB-based  script  to  accept  scenario  setup  files 

•  Time-stepped  simulation 


Surface  Warfare  (SUW) 

Application 


Apply  similar  methodology  towards  a  surface  warfare  (SUW)  mission 
area  problem 

Example:  red  surface  platforms  are  transiting  underneath  the  umbrella 
of  red  air  and  surface  defenses,  posing  a  problem  of  surveillance  and 
interceptor  placement  for  successful  red  intercept. 

Determine  the  desired  response 

-  “Final  uncertainty  penalty”  based  on  a  single  surveillance  platform  and 
multiple  interceptor  positions 

Given  the  following  options 

-  Surveillance  sensor  performance  and  scan  rates 

-  Interceptor  seeker  performance  and  scan  rates 

Determine  what  combination  of  variables  are  most  significant  to  the 
problem 

Investigate  hypothesis  of  multiple  sensors  to  add  value  to  the  situation 
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SUW  Application 
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Example  Output  (Surveillance  & 

Interceptor) 


S3 


Figure  No.  1 


File  Edit  View  Insert  lools  Window  Help 
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Plot  of  successful 
surveillance  detections 
during  scenario 


32 


31 


30 


29 


Quick-look  of  scenario 
(red  track  vs.  blue 
tracks) 
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Surveillance  detections 

interceptor  range  to  go  vs  time 
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Plot  of  interceptor 
range  to  tgt  during 
scenario 


Plot  of  “uncertainty 
penalty”  vs.  time 
during  scenario 
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Example  Output  (Surveillance) 


S3 


Figure  No.  2 


1  File  Edit  View  Insert  Toois  Window  Help 
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AEW  coverage  capability 


Plot  of  available 
surveillance  coverage 
of  entire  red  track  life 
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Surveillance  platform 
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AEW  coverage  effectiveness 
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Plot  of  successful 
surveillance  detections 
of  entire  red  track  life 
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Surveillance  platform  (#) 
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Example  Output  (Interceptor) 
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SIMMS  Display 


SIMDIS  8.6  Jul  9  2004  (sound)  File:  C:/jdk1 .4.2/Programs/MORS_red/MORS_visualization.fct 


File  Time  View  Eye  Data  Client  Audio  Overlays  Tools  Display  Map 


Help 


FT 


TRACKS  ♦  I  i  i  i 
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<M  M  <  1>  [>0  W>  @>M 


Red  Track  Life 


Time: 

Time  Step: 

Distance: 

Azim: 

Elev: 

Centered: 


Ready. 


001  00:18:32.500 
1.000  Secs 
701110.965  m 
173.916° 

42.387° 

shipl 


Interceptor  starting 
positions 


'  353.92°  . 
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SIMDIS  Display 


SIMDIS  8.6  Jul  9  2004  (sound)  File:  C:/jdk1 .4.2/Programs/MORS_red/MORS_visualization.fct 

BE® 

File  Time  View  Eye  Data  Client  Audio  Overlays  Tools  Display  Map 

Help 

» <$>  v  a  si-u-i 

<M  M  <  [>  OO  00 

Rng:  54.96  nm 


Rng:  24.69  nm 


Rng:  40.51  nm  Rng:  8.72  nm 

\ 

\  \ 

\.  \ 


Time: 

Time  Step: 

Distance: 

Azim: 

Elev: 

Centered: 


001  00:19:14.000 
1.000  Secs 
7177.223  m 
289.875° 

27.158° 
ship  1 


Ability  to  display  3D  icons  and 
dynamic  interceptor-target  ranges 


Ready. 


109.88°  'xfl 
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SIMDIS  Display 


SIMDIS  8.6  Jul  9  2004  (sound)  File:  C:/jdk1 .4.2/Programs/MORS_red/MORS_visualization.fct 


File  Time  View  Eye  Data  Client  Audio  Overlays  Tools  Display  Map 


Help 
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Time: 

Time  Step: 

Distance: 

Azim: 

Elev: 

Centered: 


Ready. 


001  00:19:42.500 
1.000  Secs 
807.558  m 
95.356° 

21.028° 

acft6 
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SUW  Run  Analysis  using  SAS 

JMP  Software 


SAS  JMP  may  be  utilized  to  show  a 
dependency  of  the  response  to  several 
scenario  variables 

Through  the  use  of  statistical  methods,  the 
significant  variables  or  interactions  between 
multiple  variables  that  may  be  discovered 
for  further  analysis 
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SUW  Run  Analysis  Using  JMP 


0  new_data3-  Fit  Least  Squares 


▼  w  Response  Unceitainty 


Parameter  Estimates 


Term  Estimate  Std  Error  t  Ratio  Prob>|t| 

( AEW_T  Q-0  ,5)*(Launch_T  Q-0 .5)  8.891226  29.34955  0.30  0.7741 


(Launch_scan-7)*(Launch_T  Q-0 .5) 

1.1278333  1.956637 

0.58 

0.5893 

▼  Effect  Tests 

Source 

Nparm 

DF 

Sum  of  Squares 

F  Ratio 

Prob  >  F 

AEW_scan 

1 

i 

128.42826 

5.8240 

0.0606 

AEWTQ 

1 

1 

189.72043 

8.6034 

0.0325 

AEW_scan*AEW_TQ 

1 

1 

6.25444 

0.2836 

0.6171 

Launch_scan 

1 

1 

40.12238 

1.8195 

0.2352 

AEW_scan*Launch_scan 

1 

1 

0.00293 

0.0001 

0.9913 

AEW_T  Q*Launch_scan 

1 

1 

0.45632 

0.0207 

0.8912 

Launch_TQ 

1 

1 

8.35181 

0.3787 

0.5652 

AEW_scan*Launch_T  Q 

1 

1 

0.12286 

0.0056 

0.9434 

AEW_T  Q*Launch_T  Q 

1 

1 

2.02378 

0.0918 

0.7741 

Launch  scan*Launch  TQ 

1 

1 

7.32677 

0.3323 

0.5893 

►  Effect  Details 

►  Scaled  Estimates 


Prediction  Piofilei 


■e 

8 


23  .6656  - 


11.65451 
+3.01 78 


3  .9432  - 


,  Li 

jJ  , 

— T 

T - i  T 

PT1 

iti 

0.5 


7  - 


0.5 


AEW_scan  AEW_TQ  Launch_scan  Launch_TQ 


►  Interaction  Profiles 


This  example  shows  that  the  surveillance  scan  rate  and  “tracker  quality”  (probability 
of  detect  and  how  much  “uncertainty  penalty”  is  reduced  with  each  successful 
detection)  are  most  significant  factors.  Little  interaction  between  cross  products. 
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SUW  Run  Analysis  of  #  of 
Surveillance  Platforms 


•  Test  hypothesis  of  adding  two  surveillance  to  the 
scenario 

•  Examine  the  “uncertainty  penalty”  at  intercept 

•  Quantify  this  improvement 

•  This  improvement  is  also  dependent  on  the  quality 
of  additional  surveillance 

-  If  you  add  a  poor  platform  to  the  mix,  it  may  get  worse 
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#  Surveillance  Assets  Utility  for 

SUW  Scenario 


The  average  “uncertainty  penalty”  shows  a  decrease  when 
two  surveillance  platforms  are  used  within  the  same  case 


UNCLASSIFIED 


Uncertainty  Improvement 


#  Surveillance  Utility 
Quantification  for  SUW  Scenario 


Improvement  of  Uncertainty  with  2  x  AEW 

50.00%  i - 

45.00% - 1—4 - 

40.00% - - 

35.00% - - 

30.00% - - 

25.00% - - 

20.00% - - j== - 

15.00% - — — -  -  - - 

10.00% - 

5.00% - -  ---  -  --  -  -  -  -  - 

0.00%  \ - - - T - - - T - - - T - - 

case  1,  1  AEW  case  2,  1  AEW  case  3,  1  AEW  case  4,  1  AEW 

Case 


Quantify  this  improvement  in  “uncertainty  penalty”  with  using  two  surveillance 
platforms  over  one.  See  notes  on  the  case  configurations.  It  should  be  intuitive 
that  adding  an  additional  “good”  surveillance  platform  provides  more  value  than 
a  “bad”  one.  From  the  graph,  you  could  investigate  if  a  better  track  quality  may 
indeed  be  better  than  increasing  the  sensor  scan  rate. 


Good  scan  rate  is  half 
the  revisit  time  over  a 
bad  scan  rate 


Good  TQ  reduces 
“uncertainty  penalty” 
double  over  a  bad  TQ 


Scan  rates 

Track  Quality 

case  1 

good  scan 

low  TQ 

case  2 

good  scan 

good  TQ 

case  3 

bad  scan 

good  TQ 

case  4 

bad  scan 

low  TQ 
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Conclusion 


•  The  objective  of  this  project  was  to  develop  a 
methodology  to  allow  a  system  of  systems 
analysis  to  be  performed 

•  There  are  many  different  tools  that  contribute  to 
the  overall  analysis  that  may  be  used 

•  There  are  many  applications  for  this  methodology 
to  be  applied 

-  Surface  Warfare 

-  Undersea  Warfare 

-  Expeditionary  Warfare 

•  This  project  is  also  intended  to  discover  additional 
questions  during  the  scenario  analysis  for  follow 
up  with  increased  investigative  abilities 
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